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ABSTRACT 

A study investigated the reliability of international 
students' Engl ish-as-a-Second-Language (ESL) class performance as a 
predictor of academic performance. Subjects were 169 international 
students at Portland State University (Oregon) whose freshman and 
sophomore grade point averages (CPAs) and English language test 
scores for each language skill (listening, speaking, reading, 
writing) were analyzed and correlated with demographic 
characteristics (gender, major type, age, nationality, number of ESL 
classes taken, previous English-language college experience, 
educational level, university entry date). Results were mixed. While 
ESL and academic grades correlated strongly for some groups, it was 
unclear which variables had the strongest effect because of subgroup 
composition. Two clear patterns emerged: (1) ESL students with 12 or 
more ESL classes maintained consistent academic GPAs across time, 
while others (ESL and non-ESL) had initially higher but declining 
GPAs; and (2) groups with strong ESL-academic GPA correlations tended 
to do better in college. Language scores were correlated to both ESL 
and academic grades, (Author/MSE) 
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In order to determine the reliability of international 
students » English as a Second Language (ESL) class 
performance as a predictor of academic performance, a 
population of 169 international students at Portland State 
University (PSU) in Portland, Oregon were selected and 
statistical tests were performed on their CPAs and TOEFL 
scores • 

Individual students' CPAs were computed for all ESL 
classes taken and for each component — grammar, reading, 
writing, and speaking/ listening--as well as for the end of 



the first quarter, first year, and second year of academic 
study. Pearson Coefficient Correlations were then computed 
for the ESL and academic GPAs. 

The students were also divided into subgroups based 
upon gender, nature of academic major (more-verbal or less- 
verbal), age, nationality (Asian or Middle-Eastern), number 
of ESL classes taken, amount of previous English-speaking 
college experience, prior education level, TOEFL score, and 
PSU entry date. Then mean GPAs were calculated for each of 
these which were compared by T- tests. 

The results were mixed. While it was clear that ESL 
grades and academic grades correlated strongly for some 
variable groups, it was difficult to determine which 
variables had the strongest effect because of subgroup 
composition. For example, female students, students from 
Asia, and students whose majors fit the more-verbal category 
showed strong and statistically significant correlations for 
ESL-second year academic grades; but 90% of the women were 
from countries of Asia, and the proportion of both Asian and 
female students in the more-verbal majors was much .higher 
than that of males or students from countries of the Middle 
East. 

There were two patterns that stood out in the research 
results. One was that ESL students who had taken twelve or 
more ESL classes maintained consistent academic GPAs across 
time, while those who had taken fewer than twelve ESL 



classes and all students in the non-ESL group had CPAs that 
started higher than those of the first group but declined 
over the two year period — some of -chem enough to be 
statistically significant. 

The second pattern was that groups with strong ESL- 
academic GPA correlations tended to do better in college 
that did those with weaker ESL-academic GPA relationships. 

TOEFL scores were correlated to both ESL and academic 
grades. In the first case, there were both moderately 
positive and statistically significant relationships. In 
the second case, the correlations were very low; and for 
non-ESL students, there was essentially no correlation. But 
comparing mean academic CPAs showed a significant difference 
between students who scored below 500 and those who scored 
500 and above on the TOEFL. 
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CHAPTER I 



INTRODUCTION 

THE INFORMATION NEED 

The importance of international students to higher 
education in the U.S. is growing annually, and Portland 
State University (PSU) is part of that trend. The number 
of students on F-1 (study) visas at PSU increased 9% 
between fall, 1989 and a year later — from 740 to 809 (PSU 
Office of Institutional Research and Planning) . 

What are the primary courses of study chosen by the 
international students? Until 1989, more than half of 
those students nationwide majored in some type of 
engineering; but during 1990, the percentage in engineering 
programs was surpassed by those in business studies: 19% 
and 20%, respectively (Wilson, 1990). At PSU, the number 
of international students enrolled in engineering programs 
declined from 142 during the 1989-1990 school year to 140 
the following year. During the same time, the number 
declaring business and management majors rose from 176 to 
186 — a total of nearly 23% of international enrollment. 

Assessing the academic preparation of students from 
diverse countries is difficult at best (Perry, 1989), so 



reliable predictors of their academic success are needed. 
Wardlow (1989) used a full population of 3 27 Moroccan 
students at the University of Minnesota and discovered that 
their English proficiency was more strongly related to 
their academic success than were their scholastic 
backgrounds, as evaluated by his university. Additionally, 
intensive English programs are growing, changing, and 
searching for ways to better help their students to become 
reasonably proficient in the language and to adapt 
culturally as well as academically. 

Admissions offices, departments within universities, 
and the students themselves all need reliable predictors of 
academic success. Additionally, English as a Second 
Language (ESL) program staff and administrators want to 
know if their programs are effective. 

DESCRIPTION OF THE ESL PROGRAM AT PSU 

Intensive English classes were first established at 
PSU in 1964, to assist students from Saudi Arabia in their 
English acquisition. The program has four levels 
(I-beginning, Il-low intermediate. Ill-intermediate, and 
IV- advanced ) , each of which consists of four components: 
grammar , reading , writing , and speaking/ listening . The 
reading and writing components occasionally have the same 
instructors, and students are strongly advised to take 
those courses together. Until 1989, there were also other 
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classes offered: vocabulary, pronunciation, library, study 
skills, and cultural orientation. These functions are now 
included within the four main segments. The program 
includes other classes as well: a preparatory class for the 
Test of English as a Foreign Language (TOEFL) for advanced 
students; a new class to assist international graduate 
teaching assistants with their pronunciation, stress, 
intonation, and classroom teaching skills; and a new 
adjunct geography class. 

PSU requires undergraduate students from countries 
where English is not the primary language to achieve a 
minimum score of 525 on the TOEFL prior to beginning 
academic study. If they do not meet this guideline, they 
are tested (the Michigan [Michigan Test of English Language 
Proficiency] , the CELT [Comprehensive English Language 
Test], and a holistically-scored in-house writing te-;t) and 
placed in appropriate levels of ESL classes. An 
undergraduate who has attended and passed at least the 
highest level (Level 4) of ESL classes may be allowed to 
begin academic courses with a TOEFL score of 500 and the 
permission of the ESL program coordinator. Also, advanced 
students may be allowed to take some academic courses 
(again, based upon required approval) when they are in 
their final quarter of ESL. These courses are usually of 
the 'less-verbal' type — math, music, etc. 
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The ESL program falls under the auspices of the 
Department of Applied Linguistics and relies heavily upon 
students from its Teaching English to Speakers of other 
Languages (TESOL) teacher training program for both tutors 
and Graduate Teaching Assistants (TAs) . Full time teachers 
teach 12 hours per week, part time, 8-11 hours, and TAs, 
5 hours. During the 1991-1992 academic year, there were 
three full-time and four part-time instructors as well as 
eight TAs. Several of the teachers and some TAs also teach 
English for Non-Native Residents (ENNR) , a separate but 
similar intensive English program also administered by the 
Applied Linguistics Department. 

HYPOTHESES 

This study was undertaken to determine the predictive 
value of intensive English language program performance for 
undergraduate academic performance (the criterion variable — 

Brown, 1988) by: a) establishing the correlations of both 
overall and component ESL grade point averages (CPAs) with 
later academic CPAs for all ESL subjects and for those 
grouped by i:oderator variables (factors that might moderate 
the affect of predictive or criterion variables) and b) 
comparing the academic CPAs of students who have taken at 
least four ESL classes with those of students who have not. 
The following hypotheses were to be tested: 




1. F-1 visa students' ESL CPAs will correlate 
significantly and positively with their college 
CPAs at the end of the first year of academic 
study, but not at the end of the second year. 

2. The correlations of overall ESL CPAs to academic 
CPAs and those of specific language skill (reading, 
writing, etc) CPAs to academic CPAs will be 
essentially the same. 

3. ESL GPAs will correlate to academic GPAs more 
strongly for more-verbal majors than they will for 
less-verbal majors. 

4. The correlations of ESL to academic GPAs among the 
moderator variable groups of gender, age, and 
nationality will be essentially the same. 

5. There will be no statistically significant 
difference between the mean academic GPA of former 
ESL students and the mean academic GPA of other F-1 
visa students who have taken no intensive English 
classes in the U.S. 
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CHAPTER II 
LITERATURE REVIEW 
INTRODUCTION 

The studies reviewed for this research correlated 
dozens of possible predictive variables with the criterion 
variable of academic performance for international students 
in the U.S. and found relationships that ranged from 
moderately negative to strongly positive (Dunn, 1990; 
Wardlow, 1989) . 

Some have used graduate students (Hwang & Dizney, 1970; 
Covert & Chansky, 1975) , while others used undergraduates 
(Sugimoto, 1966; Harvey, 1979); some have used standardized 
test scores (Burgess & Greis, 1970; Sharon, 1972), while 
others used non-cognitive factors (White & Sedlacek, 1986; 
Boyer & Sedlacek, 198<J) ; and some have used pre- or post- 
admission English test or English class scores (Rosberg, 
1983; Woodbridge, 1986), while others used prior academic 
performance — high school or undergraduate (Perry, 1989; 
Case & Richardson, 1990) . 

The studies reported here are arranged by possible 
predictor or moderator variables (as defined by the 
authors), and within those categories, by the results. 
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English Language Training 

No Significant Results . One of the first studies to 
correlate ESL course performance to later college work was 
undertaken by Mason (1971) • He compared the content-course 
performance and scores on a post-first semester English 
skills test of 15 ESL students and 9 non-ESL foreign 
students, and found no significant difference, but he did 
not correlate ESL grades with college grades • On the basis 
of these small samples and without giving explicit 
statistical information, the author concluded that 
intensive English programs have no significant effect on 
content course performance • This study was cited and used 
by Mossback (1977) , along with two others he reviewed, to 
conclude that general ESL courses are "largely a waste of 
resources" (p, 318) . Rosberg also quoted Mason when he 
described, his own research into the effects of ESL courses 
on later community college study. He found no clear 
pattern to that relationship, but 54% of his subjects did 
not graduate from the two-year college • 

Bostic (1981), with information from 154 students, 
found no significant difference between the academic 
performance of groups with and groups without resident ESL 
training. Dunn, in her study of 274 students a: PSU, 
discovered no significant difference in academic 
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performance between any of four English for Non-Native 
Residents (ENNR) groups and one control group. She 
qualified her findings by stating that the control group 
was not ideally matched in English ability to the ENNR 
groups. Neither Bostic nor Dunn compared intensive English 
class performance with subsequent academic achievement 
level. 

Significant Positive Correlations . Wardlow, with 327 
Moroccan students, and Zirpoli, Hallahan & Kneedler (1988) , 
with only 19 Indonesian students, both found English 
language training scores significantly related to later 
college performance. Wardlow, in fact, declared it as 
predictive as prior academic achievement in the students' 
home country. Woodbridge, in a study of 49 students, 
determined that CPAs for all ESL courses as well as that 
for each English skill area correlated significantly 
(r=.4 6) with first-year college grades. 

Significant Negative Correlations . Perry compared the 
university CPAs of groups with and groups without ESL 
courses in a study that combined deita from the University 
of Minnesota and the University of Wisconsin, Madison. He 
found that the group without resident ESL training had a 
significantly higher mean GPA than the ESL group. Although 
his investigation used a large, full population — 196 at 
Minnesota and 376 at Wisconsin — the value of the finding 
could be questioned on several grounds: 1) the ESL group 



21 



included subjects with as little as one semester of 
intensive English anywhere in the U^S,, 2) the actual 
differences in the means were small, according to the 
author (.11 at Wisconsin and .26 at Minnesota), and 3) 
there appeared to be few control variables for the 
different groups. Also, he did not calculate correlations 
of ESL and academic grades. 

Shilling (1987) looked at data from 37 ENNR students 
and found that those who had the fewest years of what she 
called English language training entered the ENNR program 
at higher levels and then obtained higher content-course 
GPAs than did those with the most years of English language 
training. She admitted., however, that she encountered many 
problems in gathering data, and this may have influenced 
her results. 

English for Specific Purposes . The preceding research 
considered gereral ESL as an independent variable. 
Mossback argued for the use of English for Specific 
Purposes (ESP) rather than general ESL. Other similar 
arguments are popular now, but I was not able to locate 
studies that 1) compared academic performance of students 
after ESP courses to that of others after general ESL 
courses, 2) compared the performance of students who had 
ESP training to those with no resident intensive English 
classes or 3) correlated accomplishment in ESP classes to 
that in later academic coursework. 
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Adjunct Course Model . Although intensive English 
programs have been used for decades, the use of adjunct 
courses (academic classes in conjunction with ESL classes; 
the former provides the content for the latter) is 
relatively new and appears to be growing, Adamson (1990) 
speculated that ESL courses are not truly helpful to 
college-bound students because they generally do not teach 
academic skills, and' he described adjunct pre-courses 
established to assist students in developing academic 
skills. 

Apodaca, in her 1985 paper, stated: 

The content of ESOL [English for Speakers of 
Other Languages] courses is not adequate for the 
proper preparation of ESOL students to go into 

regular content-area and English courses our 

students need to be prepared beyond the 
interpersonal communication skills level to the 
academic language proficiency level, (p. 1) 
She continued with a discussion of what she called a high 
intensity language training (HILT) curriculum in ESL that 
included subject area courses at all ESL levels. 

Unfortunately, Adamson did not reveal the 
effectiveness of the pre-courses, and Apodaca, although she 
asserted that the HILT program was successful, offered no 
evidence to that effect. 
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English Proficiency Tests 

Some two dozen studies are available that have 
correlated the Test of English as a Foreign Language 
(TOEFL) scores to academic achievement level, and their 
results have been nearly as mixed as have those that used 
some notion of English proficiency as a predictive 
variable. Grade correlations with English tests other than 
TOEFL have also been considered — some pre-admission and 
some post-admission - 

No Significant Correlation . Hwang & Dizney, in one of 
the first studies of the TOEFL as predictor of academic 
success, Sharon, Light, and Xu & Mossop (1987) , all found 
positive but insignificant correlations. Neither Zirpoli 
et al nor English (1988) found a significant relationship 
between TOEFL scores and CPAs. 

TOEFL total and subtest scores correlated inversely to 

GPAs, but not significantly so, in a study by Woodbridge. 

Adamson found that students who got high scores on 
English tests did not necessarily get high scores on 
content-course exams. 

Significant Correlations . Burgess & Greis discovered 
low but significant correlations between college grades and 
scores on both the Michigan and TOEFL. Dividing data from 
176 international students into three groups — total GPAs, 
GPAs less freshman- level English, and GPAs without grades 
from less-verbal courses such as math, they found little 

* J 
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difference in the correlations among these groups. Rosberg 
found high positive associatiors between both Michigan and 
TOEFL scores and community college CPAs. Although his 
sample was sizeable (N=263) , he revealed doubts about the 
study's meaningfulness because of the narrow GPA range: 82% 
of them fell between 1.76 and 2.50, while only 1.14% were 
over 3.25. 

Total and subtest TOEFL scores were declared mildly 
predictive (r=.34 to r=.55) by Gue & Holdaway (1973) and 

Hiel & Aleamoni (1974) , and the latter concluded that the 
TOEFL is as good a predictor of academic success for 
international students as the GRE is for American students. 
Harvey found TOEFL subtest scores and college grades 
significantly related. In comparing TOEFL subtest scores 
to later performance, Perry found the strongest 
relationship with GPA in the Reading/ Vocabulary subtest, 
and Gue and Holdaway found the Reading/Vocabulary and 
Listening Comprehension scores correlated higher than did 
the others. Ironically, Perry found the Listening 
Comprehension scores to be the only ones not significantly 

associated with grades. 

Using data from 1375 students at UCLA, Sugimoto found 
pre-admission test scores to be among the least predictive 
of numerous variables. The grades of writing tests in 
freshman-level English appeared to best predict academic 
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performance in Burgess & Greis' study. De Wolf (1980) 
found that students who received high verbal scores on a 
battery of pre-college English proficiency tests had higher 
first-year CPAs than did students with low scores, but her 
data were not analyzed statistically. English found high 
correlations (r=.74 and r=.75) between the Test of Written 

English (TWE) and second term CPAs for 21 students. First 
term CPAs, however, were not significantly related to the 
TWE scores . 

Other Test-Variable Relationships . Bostic and Perry 
both found TOEFL scores more strongly related to grades in 
what they considered less-verbal fields (math, engineering, 
music) than in more-verbal fields (English, sociology) . 
Light et al, however, found the lowest TOEFL-GPA 
correlations with business majors and the highest with 
education and public affairs majors — the last two among the 
most verbal of fields. Harvey found a wide variation in 
the relationships of TOEFL scores with CPAs in major 
fields. In his study, CPAs rose with TOEFL scores for 
students in the areas of Arts & Letters, Science, and 
Social Science. For Health & Physical Education and 
Business Administration majors, however, CPAs declined as 

TOEFL scores increased. Some GPA differences were large, 
but he did not test the variations for significance. 
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Graham (1987) declared that studies which include 
broader ranges of TOEFL scores and grades show higher 
correlations* Yet Perry found that eliminating the lowest 
(<475) and the highest (>649) scores produced the strongest 
correlations* Henning (1987) speculated that as students 
become more proficient in English, correlations between 
proficiency test scores and GPAs should become weaker. 

Two studies, Hwang & Dizney and Hosley & Meredith 
(1979), found strong correlations between TOEFL scores and 
ESL course grades. The first compared the Listening 
Comprehension subtest scores with the composite grades on 
15 quizzes in ESL courses; the second correlated total 
TOEFL scores to cumulative GPAs in ESL courses (r=.66). 

Previous Scholastic Performance 

The inquiries into the relationship of prior academic 
preparation and college success all found positive, 
significant correlations except one: Covert & Chansky, In 
comparing undergraduate GPAs (UGPAs) with graduate GPAs 
(GGPAs) , they found a positive but not significant 
connection. Their data did indicate, however, that the 
higher UGPAs were more predictive than were the lower ones* 
Perry, Sharon, and Case & Richardson all found UGPAs 
to be good predictors of GGPAs. Perry further investigated 
the relationship of UGPAs to GGPAs by field of study and 
revealed no significant differences in those correlations. 
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Lukas (1989) discovered a significant relationship between 
previous scholastic performance and UGPAs. She also 
discovered that the mean GPA of her sample (N==175) of 
international students was higher than that of all other 
students at her university. Sugimoto found a significant 
correlation between first semester UGPAs and later academic 
level of success. 

Combined and Other Variables 

Lukas, Perry, Sugimoto and VJoodbridge all examined 
nationality and found no significant relationship with 
college grades. In de Wolf's investigation, students from 
European countries other than the British Isles obtained a 
higher mean UGPA (2.88) than did those from African 
countries (2.55), but the difference was not statistically 
analyzed. 

White & Sedlacek and Boyer & Sedlacek looked at non- 
cognitive variables, using standardized personality tests 
and questionnaires, and determined that: a) in the first 
study, leadership skills and positive self --concept were 
strongly correlated with academic success and b) in the 
second, self-confidence and understanding of racism related 
best to GPAs. 

Several researchers have either combined variables — 
usually prior scholastic performance and pre-admission test 
scores — or looked at multiple variables in order to 
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determine the most predictive combination. Perry found 
that the TOEFL 's Reading/ Vocabulary subtest scores combined 
with academic preparation yielded the highest correlates. 
Information such as type (and country) of last school 
attended, amount of previous college, type of visa and 
residency status were examined by de Wolf and displayed 
some differences, but as mentioned before, she did not 
analyze her data statistically. Sugimoto reviewed 18 
variables, using Chi Square analysis, and found no strong 
predictive ability. Case & Richardson reviewed 28 possible 
predictive and moderator variables (factors that might 
influence predictive or criterion variables) and discovered 
that UGPA, GRE scores, ethnicity and gender were the best 
combined predictors. Shilling considered 37 factors (for 
ENNR students) and found the best correlation to academic 
performance among them was the presence or absence of the 
student's father combined with the type of diploma 
received. Major field of study was determined to be the 
only significant predictor of first semester GGPA by Stover 
(1982), but most of his subject groups ranged from N=5 to 
N=i6 — -probably too small to be meaningful. 

CONCLUSIONS FROM THE LITERATURE REVIEW 

Boyer & Sedlacek observed that, "Despite the extensive 
literature on international students, much remains to be 
learned about the variables related to their academic 
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success" (p, 219) • This review of relevant research seems 
to confirm that this is so, despite the appearance that 
recent investigations are of better quality than were many 
of the earlier ones. 

Measurement Problems 

Academic performance has been variously defined in the 
literature. Some researchers have simply rounded GPA to a 
four- or five-point scale (Perry; Dunn) , while Rosberg used 
a full range of GPA — for example, 2,45, 3.87, etc. At 
least one investigation defined academic success as a GPA 
greater than 2.00 (Shilling). Still others have combined 
GPA with number of credits completed (Light et al) , or 
student retention — just staying in school (Boyer & 
Sedlacek) . 

An additional complication is that studies of 
undergraduates have a broad range of GPA with which to 
work — from a theoretical 0.00 to a 4.00, while those that 
use graduate students suffer from skewed GPAs between 2-50 
or 3.00 and 4.00. 

The diverse operational definitions of academic 
performance alone could account for wide variation in 
results, but there are other factors that appear to 
contribute to the measurement problem. While some 
researchers have used hundreds of subjects (Bostic; Dunn) , 
many have used numbers so low that validity is 



18 



questionable-9, ii, 15, etc. (Mason; English), other 
inquiries that used large samples or full populations and 
divided those into subgroups, frequently ended up with 
small or vastly unequal group sizes: li in one, 43 in 
another and 126 in yet another, for example (Stover; Lukas; 
& Woodbridge) . still other researchers did no statistical 
analysis, or did so on only some of the data (de Wolf; 
Harvey) . 

Graham, in a discussion of the difficulties involved 
with relating English proficiency to academic success, 
points out that many variables not usually controlled or 
accounted for may distort the results. , Number of classes 
taken, financial condition, and professorial attitudes can 
combine with difficulties of cultural adjustment or 
negative political developments in the students' home 
countries and create tremendous interference with their 
ability to function normally, a poignant recent example is 
the effect of the 1991 war in the Middle East on students 
from that area. 

Finally, either most of the researchers whose work I 
reviewed did not account for many of the potential 
moderator variables (age, gender, nationality, prior 
education level, number of classes taken, and major field 
of study) , or if they did, did not explain which ones and 
how. It seems to me other factors may account for some of 
the variation in findings. 



since there seem to have been few thorough and 
meaningful investigations of how success in intensive 
English programs relates to later scholastic achievement, 
perceive a need for the present study • 



CHAPTER III 



METHOD AND PROCEDURES 
INTRODUCTION 

In this chapter I will first review the procedures and 
rationale used in the selection of subjects, will then 
discuss my operational definition of performance, and 
finally, will discuss the data and the manner in which. it 
was grouped and statistically analyzed, 

I attempted to select only those students who would 
fit into groups based upon what I considered moderator 
variables — variables that might have some effect on the 
relationship between ESL performance and academic 
performance, and which are described on the following page. 
The objective was to determine if some group (s) showed 
stronger ESL~academic GPA correlations than did others. As 
was stated in the conclusion of the preceding chapter, most 
studies either have not accounted for most of the variables 
I have, or the researchers did not make it clear which ones 
they did take into account. 
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SUBJECTS 

Selection 

A list of undergraduate students at PSU who held F-1 
(study) visas, who had entered the university since 1981, 
and who had last attended during or after fall, 1989, was 
initially compiled (N=375) • Purged from this list were 
students a) whose first language is English; b) who had not 
completed at least one full-time quarter (9 credits 
minimum) of academic study; c) who had attended one year or 
more of high school in the U.S. or other English-speaking 
countries (to equalize pre-college exposure to formal 
English) ; d) who had taken between one and three ESL 
courses (to create a clearer distinction between ESL and 
non-ESL subjects) ; e) who had obtained the equivalent of a 
bachelor's degree in any country (there were too few of 
these to form a group of adequate size) ; and f ) whose level 
of prior education, age, gender, nationality, PSU entry 
date, or general field of study (all variables I wished to 
consider) were indeterminate. The number of remaining 
subjects was 169, divided into the main groups of ESL (77) 
and non-ESL (92) . 

For this study, I considered ESL performance to be the 
predictive variable and academic performance to be the 
criterion variable. In order to examine the effect of 
potential moderator variables, both ESL and non-ESL 
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categories were further divided into intermediate groups of 
gender, the nature of their majors, age, nationality, 
previous English-speaking college experience, prior 
education level, TOEFL scores, date of PSU entry, and — for 
ESL students — the number of ESL classes taken. These 
intermediate groups were further divided into subgroups of 
male & female; less-verbal & more-verbal majors; under 24 & 
24 and older; Asian & Middle-Eastern; some previous 
English-speaking college & none; one quarter of prior 
college & two quarters or more; TOEFL scores of ESL 
subjects — less than 500 & 500 and higher, and of non-ESL 
subjects — less than 551 & 551 and higher; students entering 
PSU prior to fall, 1988 & those entering fall, 1988 and 
later; and less than twelve ESL classes taken & twelve or 
more. Figure 1 shows a diagram of this grouping hierarchy. 

It would have been ideal to divide subjects into 
specific nationality and specific major subgroups, but it 
was not possible to do so and maintain an adequate number 
of subjects per subgroup (N) . Also, the status of English 
as an official language in some of the countries 
represented by the students might 'be a moderator variable; 
but again, to have eliminated or grouped subjects 
accordingly would have created subgroups that were too 
small. 

The exact composition of the main groups, intermediate 
groups, and subgroups is shown in Appendices A & B. 
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Highlights of Group Composition 

Major Fields of Studv > Subjects were divided into 
more-verbal and less-verbal major subgroups based upon 
categories used by the International Education Data 
Collection Committee (1989) : 

More- Verbal Less-Verbal 
Business & Management Architecture/Environmental Design 

Education Computer & Information Sciences 

Foreign Languages Engineering 
Letters Health Sciences 

Psychology Life Sciences 

Public Affairs Mathematics 

Social Science Visual/Performing Arts (except 

Theater Theater) 

Nearly 40% of both ESL and non-ESL students were majoring 
in subjects within the university's School of Business and 
about another 1/3 of each in engineering or computer 
science* See Appendix A for exact numbers ♦ 

Gender and Age * The proportion of female students in 
both the ESL and non-ESL main groups was similar — slightly 
more than one third of each. Among ESL students, half were 
24 years or older and half under 24, while 54% of non-ESL 
students were 24 and over. 

Nationality . The majority of international students 
at Portland State are from Asia, predominantly China 
(including Hong Kong and Taiwan) and Japan, while the 
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second largest group was from the Middle East. This 
composition shows among the study's subjects overall, but 
with different proportions between the ESL and non-ESL 
groups: 60% of the ESL students were from Asia and 3 5% from 
the Middle East, while 58% of the non-ESL students were 
from Asia but only 19% from the Middle East. Put another 
way, less than half (45%) of the Asian subjects were in the 
ESL group, while 61% of the Middle-Eastern subjects were in 
that group. 

Prior Education . Only one-third of the ESL subjects 
had completed two quarters or more of college prior to 
arriving at PSU, while more than two-thirds of the non-ESL 
students had done so — some had completed several years. 

In both the ESL and non-ESL groups, about one-third of 
the students had studied in a college where English had 
been the language of instruction prior to attending PSU. 

Other Factors . The differences between ESL and non- 
ESL students' TOEFL scores and university entry dates were 
to some extent inherent in the nature of the variables 
themselves . 

In the first case, for example, some ESL students were 
allowed to take some academic studies (through the special 
permission described in Chapter I, p. 3) with a TOEFL score 
of less than 500. In the non--ESL group, though, all 
students' scores were greater than 500, and thus they 
avoided the requirement for intensive English classes. 
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Therefore, TOEFL scores ranged lower for ESL students than 
for non-ESL students* 

In the second case, almost 80% of the non-ESL students 
had entered the university during the Fall of 1988 or 
later, but only 56% of the ESL students had done so. At 
least part of this difference is due to my subject 
selection stipulations regarding the first and last 
attendance dates: some of the ESL students attended 
intensive English classes for a year or more before 
beginning academic studies, but non-ESL students began them 
immediately. 

As we will see in Chapter IV, large differences in ESL 
and academic grade correlations appeared between some of 
the variable subgroups. 

DEFINING PERFORMANCE 

As I discussed briefly in Chapter II, several 
operational definitions of educational performance have 
been used in the literature. Most of them, however, have 
included grades. According to Hiel and Aleamoni, there are 
problems with this use of grades. One is that foreign 
students are sometimes graded more leniently than are 
American students. Another is that they reflect many 
things other than learning and achievement level for all 
students: things such as motivation, cultural adjustment, 
and stress. Yet another is that there does not seem to be 
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a strong connection between the grades students receive and 
how well they succeed in the 'real' world. From a research 
point of view though, GPA is the most efficient and 
certainly the most easily quantifiable single measurement 
of performance (Lindvall, 1967; Perry, 1989) . 

GPA CALCULATIONS 

GPA for this study was calculated differently from the 
official university calculations in two ways. 

First, in cases where students received Ds or Fs but 
repeated those classes to improve their grades, I included 
both the lower grade and the one received from the repeat. 
(The university allows a student one repeat of a course in 
which a D or F was received; if a better grade is earned on 
the second attempt, this grade, rather than the first one, 
is used in the university's calculation). I included the 
lower grade in my computation because I considered those 
situations to better reflect actual performance in that a 
student who received, say, a D the first time through a 
class then a B on the second attempt did not perform as 
well as did one who received a B the first time through. 

The second way in which my calculations differed from 
the university's was in the values assigned to pass-no pass 
(P-NP) grades. The number of grade points assigned to each 
credit hour of P was 2.5 (essentially a C+) while NP was 
assigned 1 point. My justification for those numbers is <xs 
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follows. students generally, I think, take classes P-NP so 
they do not have to work as hard as they would to obtain an 
A or B yet will not negatively affect their gpAs. It seems 
reasonable to me to assume that -average' students will do 
average (c or 2.00) work in a P-NP class, while better 
students will do slightly better work-perhaps B or B- 
level. Thus the compromise of 2.5. As for the NP point 
assignment, few students actually receive an F (in my 
subjects- transcripts, there is an average of one F for 
every three transcripts-fewer than 60 Fs among thousands 
of grades). Therefore, i assumed the grade-level 
equivalent of work earning an NP would range mostly between 
D+ and D- and assigned 1 grade point to each credit hour. 

Although I do not think this point assignment is 
ideal, it was made necessary by the large number of ESL 
classes (27% of the total) taken on a P-NP basis. To have 
rejected those students would have reduced the number of 
subjects to an inadequate level. Academic classes taken 
P-NP were treated the same way (14% of the total). 
Although there is a difference in ratio between the ESL and 
academic classes taken P-NP, i believe that the equation is 
relatively well-balanced. Students who took many or most 
of their ESL classes P-NP also took a larger portion of 
their academic classes that way than did students who took 
all or most of their ESL classes for regular grades. 
Therefore, if the research GPAs were skewed because of the 
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P-NP point assignment, they would most likely be skewed in 
the same direction for both the ESL and academic grades of 
the same students, giving credibility to the correlations. 
The grade distribution graphs in Appendix C show little 
skewing. 

PROCEDURES 

The Data 

Five different ESL GPAs were computed in order to 
analyze their relationships with academic GPAs. First, 
grades were averaged for all ESL classes taken by each 
student; then the same was done for each component — 
grammar, reading, writing, and speaking/ listening. Twelve 
of the subjects had not taken a grammar class and thus had 
only four ESL GPAs. 

Three different GPAs were calculated for academic 
classes: at the end of the first quarter, the end of the 
first year, and the end of the second year. Each of these 
included the credits and grade points of the previous 
computation, so they are cumulative. I originally proposed 
to calculate GPAs at the end of three years, but there were 
too few subjects who had completed three years. 

In order to check performance differences between the 
main groups and subgroups, mean ESL and academic GPAs were 
calculated for each. 



The Statistical Tests 

I performed several statistical tests* First, 
Pearson Correlation Coefficients (Pearson r) were 

calculated for the subjects' ESL and academic grades. 
Next, independent r-tests were performed on all GPAs 

between subgroups of the ESL students. Third, I ran 
independent r-tests on academic GPAs between the main ESL 

and non-ESL groups, then between subgroups within each. 
Fourth, correlations were calculated for the ESL students' 
TOEFL scores and ESL component (grammar, reading, writing, 
and speaking/ listening) grades. Next, correlations were 
calculated for the subjects' TOEFL scores and three 
academic GPAs to ascertain the value of the TOEFL as a 
predictor of academic success. And finally, academic GPAs 
were compared by f-tests between students who scored lower 

and those who scored higher on the TOEFL. 

The data distribution graphs in Appendix C show that 
the data formed a relatively normal distribution, and 
therefore parametric tests such as the Pearson correlation 
and r-tests were appropriate to use. 



CHAPTER IV 

RESULTS OF STATISTICAL TESTS 

INTRODUCTIO^^ 

In this chapter I will first show the Pearson 
Correlation Coefficients (r) found between ESL and academic 

CPAs for the entire ESL group and all subgroups. Second, I 
will show the results of the paired r-tests performed on 

ESL and academic grades. Then I will reveal the results of 
independent r-tests run on mean CPAs between subgroups 

within the main ESL group. Fourth, I will show the results 
of the same tests performed on academic GPAs between ESL 
and non-ESL students. Fifth, I will show the Pearson 
correlations between TOEFL scores and ESL component grades. 
And last, I will show the correlations between TOEFL scores 
and academic grades. Whenever the discussion states that 
no statistically significant relationship was found, the 
level of statistical significance is greater than p-.05, 

meaning that there is a more than 5% probability that the 
relationship could occur by chance alone. I will, however, 
note correlations that appear strong even if they do not 
meet that level of probability. 
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ESL AND ACADEMIC GPA RELATIONSHIPS 

These relationships deal with my first four 
hypotheses • The first — that ESL CPAs would correlate 
significantly and positively with first year academic GPAs 
but not with those for the second year — was not confirmed. 
All together, there were 29 positive and statistically 
significant subgroup correlations between ESL and first 
year GPAs and 28 for the second year. Confusing the issue 
was the fact that nearly all the second year correlations 
were higher than those of the first year, yet most levels 
of statistical significance were lower for second year than 

for first year correlations. This is most likely a result 
of the relatively small number of subjects who had 
completed two years. 

The second hypothesis — that correlations between 
academic grades and overall ESL and component grades 
(grammar, reading, writing, speaking/ listening) would be 
the same — was not supported. Writing grades consistently 
showed the strongest connections, while reading grades 
shewed the weakest. In fact, the reading component showed 
the largest portion of negative correlations; and they ranged 

as high as -<.292, although none reached statistical 
significance at an acceptable level. The 
speaking/ listening component showed the second strongest 
relationship to academic grades, and grammar the third 
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strongest (but least consistent, as I .ni au.nss i„ 
Chapter V) . 

Hypothesis nuaber three was that the ESL-acade.ic 

grade correlations for stud^m^-o • 

iiiD snuaents m more-vp-rHa i -m^-^ 

luuie vernal majors would 

be stronger than that for students in less-verbal .a^ors 

ana this was supported. The differences here were guite' 

dramatic as the tables on page 39 demonstrate. 

Hypothesis number four- 

^uer rour -that there would be little 

«fference in ESL and academic aPA correlations based upon 
the moderator variables of gender, age, and nationality- 
was rejected. There were large differences between the 
correlations of »,ale and female subgroups, different age 
subgroups, Asian and Hiddle-Eastern subgroups, and 
subgroups based on number of ESL classes taKen. These are 

exhibited in Tables li ttt ..t,^ t/t v-r 

II, III, and VI-XI and the scattergrams 

in Figures 2-5. 

Pearson Correl H_ Mon,Coefficients 

For the entire group overall ESL grades correlated 
weakly but significantly (,^.003) with college grades at 
the end of both the first (y x) and second (Y 2) years 
The only component grades that correlated significantly 

with first and second vear u 

^ona year grades, however, were those of 

writing. Grammar grades showed a very small but 
significant correlation to first year gpas. no other 
Significant relationships were found here; in fact, the 
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correlation coefficients for ESL grades and first quarter 
grades were very low. These relationships are shown in 
Table I. (In Tables I-XIII, the correlations that met or 
exceeded my desired level of statistical significance are 
marked by *) . 

TABLE I 



ESL-ACADEMIC GPA CORRELATIONS, ALL ESL STUDENTS 



Group 


+N 


++0/A ESL Graimar 


Reading 


Writincf 


Spkq/Lsta 


Qtr 


77 (65) 


. 126 


. 175 


-.058 


.140 


. 071 


P= 




.28 


.16 


.62 


.22 


.54 


Y 1 


73 (61) 


.314* 


.261* 


.067 


.307* 


.216 


P= 




<.01 


.04 


.57 


<.01 


.07 


Y 2 


44 (32) 


.329* 


. 171 


. 063 


.405* 


. 240 







.03 


.55 


.68 


<.01 


.12 


+ In 


Tables 


I-XIII, 


the N for 


grammar is 


shown in 





parentheses; the N for all other components and for overall 

grades is the first number listed from the left. 

++ 0/A = overall; a weighted average of all ESL grades. 



By placing subjects into the moderator variable 
subgroups (gender, major, age, nationality, number of ESL 
classes taken, previous English-speaking college 
experience, prior education level, TOEFL scores, and PSU 
entry date) I discovered some sharp differences in 
correlations between them. The subgroups that showed the 
largest numbers of moderate to strong and significant 
correlations between ESL and academic grades were female, 
more- verbal major, under 24 years of age, Asian, twelve or 
more ESL classes, and previous English-speaking college 




experience. For the others, there were few statistically 
significant and meaningful relationships. 

Gender , Male students* overall ESL, writing, and 
speaking/ listening GPAs correlated lightly but 
significantly with their first year academic grades. All 
others were very low and three were negative. They are 
shown in Table II, 

TABLE II 

ESL-ACADEMIC CPA CORRELATIONS, MALE STUDENTS 
GPA N 0/A ESL Grammar Reading Writing Spka/Lstg 



Qtr 49(^.1) ,162 , 048 -,036 ,170 ,063 

/7= .27 .77 ,80 .24 ,67 

Y 1 46(38) ,393* ,165 ,138 ,348* ,312* 

p= <M1 .32 36 .02 .04 

Y 2 29(22) ,246 -,083 -,017 ,273 ,231 

p= ,20 Jl ,_93 .15 .23 



The pattern of GPA relationships for female students 
was unusual by comparison to the other subgroups. While 
ESL grades correlated very little with college grades for 
either the first quarter or the first year, there was a 
strong correlation with second year grades. It is 
interesting to note by comparison that first quarter academic 

grades for these students showed a lower correlation to 
second year academic grades (r=,527, /?=,044) than did the 

ESL grades. In other words, their ESL grades were better 
predictors of long-term academic success than were their 




first quarter academic grades. By squaring the Pearson r 

for the ESL-2nd year GPA correlations, we see that the 
relationship accounted for between 38% and 41% of grade 
variation. Pearson correlations are presented in 
Table III. 

TABLE III 

ESL-ACADEMIC GPA CORRELATIONS, FEMALE STUDENTS 
GPA N 0/A ESL Grammar Reading Writing Spkg/Lstq 



Qtr 28(24) .063 .282 -.034 .023 .142 

p= .75 .18 .86 .91 .47 

Y 1 28(24) .180 .337 .079 .096 .162 

p= .37 .12 . 70 .63 . 42 

Y 2 15(12) .617* .650* .638* .661* .419 

£^ .01 .02 .01 <.01 . .12 



Scattergrams illustrating the ESL-second academic year 
GPA correlations by gender are shown in Figures 2 and 3 . 
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Ficmre 2 . Male ESL students' ESL-second academic, 
year GPA correlations. 
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Figure 3 . Female ESL students' ESL-second 
academic year GPA correlations. 



Major . For students in less-verbal majors, there were 
neither large nor significant correlations between ESL and 
academic grades. See Table IV. 
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TABLE IV 

ESL-ACADEMIC GPA CORRELATIONS, LESS-VERBAL MAJOR STUDENTS 



GPA 


N 


0/A ESL 


Grammar 


Readina 


Writincf 


Spka/Lstq 


Qtr 


42 (35) 


.021 


-.037 


-.141 


.005 


-.004 




.90 


.83 


.37 


.97 


.98 


Y 1 


41(34) 


.294 


. 105 


. 054 


.249 


.224 




.06 


.55 


.74 


.12 


.16 


Y 2 


27 (21) 


.258 


. 039 


-.045 


.321 


. 196 


P= 




.19 


.87 


.82 


.10 


.33 



The situation was quite different for students with 
more-verbal majors. Grades for overall ESL, grammar, and 
writing showed moderate-to-strong and statistically 
significant correlations with both first and second year 
GPAs. Additionally, grammar CPAs correlated moderately 
with first quarter grades. The strongest relationship was 
between writing and second year GPA, while the weakest 
significant correlation was between overall ESL and first 
year college grades. Neither speaking/ listening nor 
reading grades showed significant correlations with any 
academic grades. The correlations are shown in Table V. 

TABLE V 



ESL-ACADEMIC GPA CORRELATIONS, MORE-VERBAL MAJOR STUDENTS 



GPA 


N 


0/A ESL 


Grammar 


Readina 


Writina 


Spkq/Lsta 


Qtr 


35(30) 


.256 


.446* 


. 106 


.288 


. 163 


p= 


.14 


.01 


.55 


.09 


.35 


Y 1 


32 (27) 


.368* 


.530* 


.157 


.408* 


.204 


P= 


.04 


<.01 


.39 


.02 


.26 


Y 2 


17 (13) 


. 505* 


.539 


.437 


.588* 


. 336 


P= 




.04 


.06 


.08 


.01 


.19 
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Age, Students 24 years and older showed neither high 
nor significant correlations; and six of the fifteen were 
negative, as Table VI shows. 

TABLE VI 

ESL-ACADEMIC GPA CORRELATIONS, STUDENTS 24 YEARS & OLDER 
GPA N 0/A ESL Graiamar Reading Writing Spka/Lstg 



Qtr 39(30) --143 .041 -.255 -.089 -.144 

p= . ^ 38 .82 J2 .59 .38 

Y 1 39(30) .152 .146 -.038 .182 .023 

j7= J6 .44 .82 .27 .89 

Y 2 30(22) .241 .130 -.009 .332 .128 

n= ,20 .56_ .96_^ M ^ 



Subjects younger than 24 years showed several 
moderate-to-strong and statistically significant 
relationships. Overall ESL GPAs and writing CPAs 
correlated significantly with all three academic GPAs; the 
writing-second year connection is strong enough to account 
for nearly half (r^=45%) of GPA variation. Grammar grades 
show a low but significant correlation with first year 
college grades, and speaking/ listening GPAs correlated 
significantly with both first and second year academic 
GP.s, Reading grades were not significantly related to any 
academic grades. See Table VII. 
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TABLE VII 

ESL-ACADEMIC GPA CORRELATIONS, STUDENTS UNDER 24 YEARS 



GPA 


N 


0/A ESL 


Grammar 


Readina 


Writina 


SDka/Lsta 


Qtr 


38 (35) 


.476* 


.311 


.300 


.477* 


.308 


P= 


<.01 


.07 


.07 


<.01 


.06 


Y 1 


34 (31) 


.539* 


.366* 


.278 


.514* 


.430* 


P= 


<.01 


.04 


.11 


<.01 




Y 2 


14(12) 


. 571* 


.311 


.355 


. 668* 


.552* 






.03 


.33 


.21 


<.01 


.04 



Nationality , Middle-Eastern students showed an 
unusual trend. More than half of their correlations were 
negative, with the strong negative correlation between 
grammar and second year CPAs reaching a /7=. 065 level of 

statistical significance — only a little less than the 
minimum level I chose. Additionally, all their positive 
correlations were very weak. The figures are shown in 
Table VIII. 

TABLE VIII 

ESL-ACADEMIC GPA CORRELATIONS, MIDDLE EASTERN STUDENTS 
GPA N Q/A ESL Grammar Readina Writing Spka/Lstg 



Qtr 


27 (21) 


-.119 


.023 


-.292 


. 180 


-.174 


P= 


.56 


.92 


.14 


.37 


.39 


Y 1 


26 (20) 


.206 


-.116 


-.035 


. 276 


. 048 


P= 


.31 


.63 


.87 


.17 


.82 


Y 2 


17 (12) 


. 124 


-.548 


-.148 


. 157 


. 116 


£^ 




.64 


.07 


.57 


.55 


.66 




For the 


Asian 


students , ten 


of fifteen 


correlations 


were 


statistically 


significant. 


Both overall ESL 


grades 



and writing grades correlated moderately with all three 
academic grades. Additionally, grammar GPAs correlated 
moderately with both first and second year GPAs, reading 
correlated moderately with second year GPAs, and 
speaking/ listening grades correlated lower but still 
significantly with first year academic grades. The 
correlations are shown in Table IX. 



TABLE IX 

ESL-ACADEMIC GPA CORRELATION, ASIAN STUDENTS 



GPA 


N 


0/A ESL 


Grammar 


Readina 


Writina 


Spka/Lstq 


Qtr 


44 (39) 


.315* 


.213 


.237 


.361* 


.248 


P= 


.04 


.19 


.12 


.02 


.10 


Y 1 


42 (37) 


. 429* 


.406* 


.231 


.403* 


. 370* 


P= 


<.01 


.01 


.14 


<.01 


.02 


Y 2 


24 (20) 


.450* 


.504* 


.434* 


.561* 


. 200 


P= 




.03 


.02 


.03 


<.01 


.35 



Number of ESL Classes . Students who had taken less 
than twelve ESL classes had no statistically significant 
relationships between ESL and college grades, and seven of 
the fifteen correlations were negative. See Table X. 
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TABLE X 

ESL-ACADEMIC GPA CORRELATIONS, STUDENTS WITH FEWER THAN 12 

ESL CLASSES 



GPA N 0/A ESL Grammar Reading Writing Spkg/Lstq 



Qtr 38(28) -.063 -.095 -.277 .021 -.079 

p= .71 .63 .09 .90 .64 

Y 1 37(27) .200 .088 -.103 .199 .167 

p= .24 . 66 .54 .29 .32 

Y 2 22(14) .234 -.302 -.089 .342 .222 

£S .30 J9 .70 .12 .32_ 



The largest number of moderate to strong and 
significant correlations were found among subjects who had 
taken more than eleven ESL classes. The only three that 
did not reach my desired level of statistical significance 

were those for the speaking/ listening component. The 
figures are shown in Table XI. 

TABLE XI 

ESL-ACADEMIC GPA CORRELATIONS, STUDENTS WITH 12 OR MORE 

ESL CLASSES 



GPA N 0/A ESL Grammar Reading Writing Spkg/Lstg 



Qtr 


39(37) 


. 388* 


. 359* 


.360* 


. 327* 


. 289 


P= 


.02 


.03 


.02 


.04 


.07 


Y 1 


36(34) 


.522* 


.425* 


.512* 


.517* 


. 321 


P= 


<.01 


.01 


<.01 


<.01 


.06 


Y 2 


22 (20) 


.566* 


.555* 


.566* 


. 616* 


.341 







<.01 


.01 


<.01 


<.01 


.12 




Similar 


to the 


situation 


with female 


subjects , 


the 



writing-second year GPA correlation was nearly as high as 



the correlation between first quarter and second year 
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academic CPAs (r=,625), and both were significant at 

^=•002. ESL performance appeared to be as strongly 

indicative of long-term academic success for this subgroup 
as were their first quarter academic grades. The 
scattergrams in Figures 3 and 4 illustrate the ESL-second 
year correlations for these subgroups* 
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Figure 4 . ESL-2nd year academic GPA correlations: 
students who took less than 12 ESL classes. 
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Figure 5 . ESL-2nd year academic GPA correlations; 
students who took 12 or more ESL class 

Previous English-Speaking College Experience . There were 
weak relationships between the ESL and college grades of 
students who had none of this experience: three were 
negative, and none of the positive relationships were 
significant. See Table XII. 
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TABLE XII 

ESL- ACADEMIC GPA CORRELATIONS, STUDENTS WITH NO 
PREVIOUS ENGLISH-SPEAKING COLLEGE EXPERIENCE 

GPA N oyA ESL Grammar Reading Writing Spkq/Lstq 



Qtr 

P= 


54(48) 


.145 .100 

.30 .50 


-.084 
.55 


. 141 
.31 


.133 
.34 


Y 1 


59 (44) 


.217 .175 

.13 .26 


-.043 

.77 


.211 

.14 


.149 
.30 


Y 2 
£= 


33 (27) 


.207 .057 

.25 .78 


-.146 

.42 


.307 

.08 


.206 

.25 




Students 


who had previously 


attended institutions 


where 


English 


is the language of 


instruction showed 


some 


grade 


relationships that were positive, 


strong, and 




statistically 


significant. Overall ESL 


and writing 


grades 


were 


strongly 


related to both first and 


second year 





academic grades. Reading CPAs correlated strongly with 
second year grades, and speaking/ listening grades 
correlated moderately with second year college grades ♦ 
Grammar GPAs correlated strongly with second year grades 
but the relationship was not statistically significant, 
probably because of the small number of subjects in that 
category (7) . The relationships are shown in Table XIII. 

This was one of three subgroups (along with female 
students and those who had taken 12 or more ESL classes) in 
which the correlation between writing and second year GPA 
was as strong as or stronger than that between first 
quarter and second year academic grades (r=.574, p=.065)^ 
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TABLE XIII 

ESL-ACADEMIC GPA CORRELATIONS, STUDENTS WITH SOME 
PREVIOUS ENGLISH-SPEAKING COLLEGE EXPERIENCE 

GPA N O/A ESL Graitimar Reading Writing Spkq/Lstg 

Qtr 23(17) .244 .378 .140 .256 .120 

p= ,26 .14 ,52 ,24 ,59 

Y 1 23(17) .601* .438 .391 .522* .495* 

?= <.01 ,08 .07 ,01 ,02 

Y 2 11(7) .629* .590 .656* .640* .381 

P= ,04 ._16 ,03 ,03 ,25 

Prior Education Level . The subgroups here showed 
differences that were similar to but smaller than those in 
the English-speaking college subgroup, and . logically so: 
the subgroup with less than two quarters of prior college 
included the subgroup with no English-speaking college 
attendance, while the subgroup with two quarters or more of 
prior college included those with similar amounts of 
English-speaking university experience. 

The subgroup with less than two quarters of prior 
college had only one statistically significant but rather 
low correlation — that of writing and first year grades 
(.320, ;?=.041). This does not appear to be a strong 

relationship, accounting for only about 10% of grade 
variation. 

The students' grades in the other subgroup showed two 
stronger connections: grammar and writing correlated with 
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second year CPAs at r=,552 (p=,027) and r=.465 (p=.034), 

respectively . 

TOEFL Scores , There was little difference in ESL- 
academic grade correlation between students who scored less 
than 500 and those who scored 500 or higher on the TOEFL. 
The first subgroup had virtually no statistically 
significant correlations and six of them were negative; the 
second group had four negative correlations, but three 
others, that were both positive and significant: writing 
grades correlated with both first and second year college 
grades atr=.335 (p=.028) and r=, 401 (p=.031), respectively; 

and overall ESL CPAs correlated with first year CPAs at 
r=.316, significant at ;7=. 039. 

PSU Entry Date , Students who entered the ESL program 
fall term, 1988 or later showed four negative (but not 
statistically significant) correlations and only one that 
was both positive and significant — between writing and 
first quarter academic grades (r=,307, p=,045). Those who 

entered the ESL program prior to fall term, 1988, showed 
three negative, non-significant correlations and three that 
were both positive and significant: writing grades 
correlated lightly with first year grades (r=,389, p=,023) 

and moderately with second year grades (r=.467, p=,012); 

and overall ESL grades correlated lightly with first year 
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grades (/^•344, /7=.04 6) and second year grades (r=.399, 
p=.OAO) • 

MEAN GPA DIFFERENCES BETWEEN ESL SUBGROUPS 
ESL Grades 

There were only three pairs of subgroups that showed 
statistical3-y significant differences between mean ESL 
GPAs: previous English-speaking college experience, TOEFL 
scores, and number of ESL classes taken. 

Previous English-speaking College Experience . The 
average ESL grades of students with this experience was 
2.38 (standard deviation [SD]=.602), while that of students 
without that experience was 2.79 (SD=.556), significance 
level j?=.005. This is discussed in Chapter V. 

TOEFL Scores . Students whose final TOEFL scores were 
less than 500 had a mean GPA of 2.35 (SD of .423), while 
those whose final scores were 500 or higher had a mean GPA 
of 2.89 (SD of .597), significant at /7<.0005. This finding 

reflects the relationship found between TOEFL scores and 
ESL grades as described later in this chapter — students 
whose ESL grades were very low seem to have scored lower 
than the others on the TOEFL. 

Number of ESL Classes . Although the GPAs for the 
subgroups here differed by a mean of .27 and was 
statistically significant, there can be little meaning 



attached to the finding. The difference is in large part a 
function of the niimber of classes taken: the students who 
do poorer take more classes and repeat some to improve 
grades (eighteen of the thirty-eight students in this 
subgroup had taken more than 16 ESL classes — the total of 
all four component classes at all four levels) . As I 
described in Chapter III, both the lower and higher grades 
were calculated into GPA, lowering the ESL grade average 
for subjects who took the largest number of ESL classes. 

Other Subgroups . Mean ESL CPAs were virtually 
identical for the pairs of subgroups within the 
intermediate groups of gender, major, age, and nationality. 
(The subjects from the Middle East, however, showed a SD of 
.720, while those from Asia showed one of .495). Students 
with more prior education did slightly better than those 
with less (2.62, SD=.543 and 2.53, SD=.611, respectively) 
but the difference was not statistically significant. 
Similarly, students who had entered the ESL program during 
or after fall, 1988 had slightly higher mean grade than did 
those who entered earlier — 2.61 (SD=.4 98) and 2.52 
(SD=.532), respectively, but again not significantly so. 

Academic Grades 

Gender . With respect to both first and second year 
grades, the female students did significantly better than 
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did the males, and for the first year, with a lower 
standard deviation. See Table XIV. 



TABLE XIV 

MEAN ACADEMIC GPA DIFFERENCES BY GENDER, 
ESL STUDENTS 



Subaroup 


N 


Mean 


SD 


P 


1st Yr - Male 


47 


2 .55 


.588 




Female 


27 


2.92 


. 392 


. 005 


2nd Yr - Male 


29 


2.61 


.443 




Female 


15 


2.90 


.414 


.043 


Nationality. 


Although 


all three 


GPAs for 


these two 



subgroups were quite different, only the difference between 
first year grades were significant, as shown in Table XV. 



TABLE XV 

MEAN ACADEMIC GPA DIFFERENCES BY NATIONALITY, 

ESL STUDENTS 



Subaroup 


N 


Mean 


SD 


P 


Qtr - Asian 


44 


2.86 


. 514 




Mid-Eastern 


27 


2.62 


. 530 


.072 


1st Yr - Asian 


42 


2 .85 


. 399 




Mid-Eastern 


26 


2 .55 


. 401 


. 004 


2nd Yr - Asian 


24 


2 .81 


. 452 




Mid-Eastern 


17 


2.58 


.389 


,087 



Prior Education Level . The subgroups here showed no 
difference for the first quarter, but a considerable 
difference thereafter. The data for years one and two are 
shown in Table XVI. 
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TABLE XVI 

MEAN ACADEMIC CPA DIFFERENCES BY PRIOR EDUCATION LEVEL, 

ESL STUDENTS 



Subgroup N_ 

1st Yr - < 2 Qtr 41 

> 2 Qtrs 32 

2nd Yr - < 2 Qtr 23 

> 2 Qtrs 21 



rean SD 2_ 

2.61 .453 

2.86 .421 .017 

2.62 .465 

2.80 .423 .175 



TOEFL Scores . The subgroups here revealed both 
sizeable and statistically significant differences in 
academic GPAs. Students with final TOEFL scores of less 
than 500 had lower academic grades than did those who 
scored 500 or above — significantly so for both the first 
quarter and the first year, as shown in Table XVII. This 
finding seems to contradict the very weak Pearson 
correlations between TOEFL scores and academic grades shown 
later in this chapter and will be discussed in Chapter V. 

TABLE XVII 



MEAN ACADEMIC CPA DIFFERENCES BY TOEFL SCORE GROUPING, 

ESL STUDENTS 



Subaroup 


N 


Mean 


SD 


P 


Qtr-lower scores 


28 


2.56 


.510 




higher scores 


43 


2.84 


.584 


. 04 


Yrl-lower scores 


26 


2.58 


.445 




higher scores 


43 


2.80 


.441 


. 05 


Yr2-lower scores 


13 


2.56 


.456 




hiaher scores 


29 


2.76 


.439 


. 18 
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Other. Subgroups within gender, nationality, prior 
education level, and TOEFL scores were the only ones 
between which significant academic GPA differences were 
found. But there was a pattern within one of the 
intermediate groups — number of ESL classes — that, although 
not statistically significant, might in some way be related 
to the ESL program: the grades of students who had taken 
fewer than twelve ESL classes fell from the end of the 
first quarter to the end of the second year, while those of 
students who had taken 12 or more ESL classes rose slightly 
during the same period. See Table XVIII. 



TABLE XVIII 
MEAN ACADEMIC GPAS BY NUMBER OF ESL CLASSES 



Subaroup 


Otr 


1st Yr 


2nd Yr 


Less than 12 


2 .77 


2.71 


2. 67 


12 or more 


2 . 68 


2.73 


2.75 



Although the difference between first academic quarter 
and second year grades of the group with less than 12 ESL 
classes was not statistically significant (p=.496), this 

pattern, combined with that of non-ESL students (see Table 
XXIII, on page 57) showing a greater level of statistical 
significance, suggests that the length of time spent in the 
intensive English program may have some relationship to the 
long-term academic success of its students. This will be 
discussed further in Chapter V. 
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COMPARING CPAS OF ESL AND NON-ESL STUDENTS 



My fifth and last hypothesis was that there would be 
no statistically significant difference between the mean 
GPA of the ESL students and the non-ESL students. This was 
supported for the second year, but not for the first 
quarter or first year. Additionally, comparing subgroups 
across the main groups revealed variations in those 
differences, as Tables XX through XXII show. 

Full Groups 

There were both sizeable and statistically significant 
differences between the mean GPAs of the main groups at the 
end of the first quarter and first year. Although there 
was still a difference at the end of the second year, it 
had narrowed and was no longer statistically significant, 
as shown in Table XIX. 



TABLE XIX 

MEAN ACADEMIC GPA DIFFERENCES BETWEEN ESL 
AND NON-ESL STUDENTS 



Group 


N 


Mean 


SD 


P 


Qtr - ESL 


77 


2.74 


.559 




non-ESL 


92 


3 .00 


.564 


.003 


1st Yr - ESL 


74 


2.68 


.551 




non-ESL 


92 


2.93 


.499 


.003 


2nd Yr - ESL 


44 


2 .71 


.450 




non-ESL 


63 


2.82 


.612 


. 259 
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Gender 

The women students within the ESL and non-ESL groups 
had average grades that were within • 17 of each other with 
no statistical significance and little contrast in standard 
deviations. The men, though, showed larger differences as 
seen in Table XX. 



TABLE XX 

/ 

MEAN ACADEMIC GPA DIFFERENCES BETWEEN ESL 
AND NON-ESL MALE STUDENTS 



Subgroups 


N 


Mean 


SD 


D 


Qtr - ESL 


49 


2 . 67 


.542 




non-ESL 


60 


2.98 


.581 


.005 


1st Yr - ESL 


47 


2.55 


.588 




non-ESL 


60 


2.86 


.523 


.004 


2nd Yr - ESL 


29 


2.61 


.443 




non-ESL 


43 


2.75 


.667 


.333 


Nationality 










While the students from 


the Middle 


East 


in both main 


groups had nearly 


identical 


average CPAs 


, the 


standard 



deviations for the non-ESL subgroup was considerably larger 



than those for the ESL subgroup. See Table XXI. 

TABLE XXI 



MEAN ACADEMIC GPA STANDARD DEVIATIONS FOR ESL 
AND NON-ESL STUDENTS FROM MIDDLE EAST 



Subaroup 


Otr 


1st Yr 


2nd Yr 


ESL 


.530 


.401 


.389 


non-ESL 


. 660 


. 598 


. 616 



The Asian students* grades demonstrated nearly the 
same pattern as did the male students • While the ESL 
subgroup maintained a similar GPA across the two-year 
period, the non-ESL subgroups' dropped, and the statistical 
significance of the GPA differences decreased with each 
measurement. The relationships are shown in Table XXII. 

TABLE XXII 

MEAN ACADEMIC GPA DIFFERENCES BETWEEN ESL 



AND 


NON-ESL 


STUDENTS FROM 


ASIA 




Subgroup 


N 


Mean 


SD 


P 


Qtr - ESL 


44 


2.86 


. 514 




non-ESL 


53 


3.13 


. 498 


. 008 


1st Yr - ESL 


42 


2.85 


. 399 




non-ESL 


53 


3.02 


. 451 


. 055 


2nd Yr - ESL 


24 


2.81 


. 452 




non-ESL 


36 


2.97 


. 432 


. 187 



The pattern is similar in all these relationships 
between ESL and non-ESL students: the former start with 
lower CPAs than the latter and maintain similar grades 
across the two-year period, while the non-ESL students* 
grade averages drop during the same period. This drop and 
levels of statistical significance for the full group and 
for the subgroups whose grades also declined are shown in 
Table XXIII. This finding will be discussed in Chapter V. 
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TABLE XXIII 
ACADEMIC CPA DROP OF NON-ESL STUDENTS 



Group incr 


N 


Otr 


2nd Yr 


P 


All 


62 


3.01 


2.88 


.19 


Male 


42 


2.99 


2.81 


. 04* 


Less-verbal 


34 


3.00 


2.84 


. 18 


Asian 


36 


3.13 


2.98 


. 09 



TOEFL SCORE AND GPA RELATIONSHIPS 

TOEFL Score-ESL Grade Correlations 

The Pearson Correlation Coefficients for TOEFL scores 
and ESL GPAs were statistically significant but not 
particularly strong • The highest was that with grammar, 
while the weakest was that with writing. The figures are 
shown in Table XXIV. 



TABLE XXIV 
TOEFL SCORE-ESL GPA CORRELATIONS 



N 


Grammar 


Reading 


Writing 


Spkg/Lstg 


77(59, 


gram) .459 


.370 


.275 


.412 


P= 


<.0I 


<.0I 


.02 


<.01 



Some interesting contrasts here are that writing 
grades were those most frequently, strongly, and 
significantly correlated with academic grades, while 
reading grades were the least so. The scattergram in 
Figure 6 illustrates the correlation between ESL grammar 
GPAs and TOEFL scores. 
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Figure 6 . Correlation between TOEFL scores and 
ESL grammar CPAs. 



Correlating With Academic Grades 

Neither the ESL nor non-ESL students' college grades 
in this study showed more than weak correlations to their 
TOEFL scores. For the non-ESL group, in fact, the 
correlations are near zero, as is shown in Table XXV. 



ERIC 



59 



TABLE XXV 



TOEFL 


SCORE-SECOND YEAR 


ACADEMIC GPA 


CORRELATIONS 


Group 


1st Otr 


1st Yr 


2nd Yr 


ESL 


.105 


.223 


.086 


P= 


.38 


.07 


.57 


N= 


71 


69 


42 


non-ESL 


-.017 


. 012 


-.060 




.88 


.91 


.66 


N= 


83 


83 


55 
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Figiires 7 and 8 illustrate tliese relationships. 
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Figure 7 . Correlation of TOEFL scores to second 
year academic grades for ESL students. 
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Ficfure 8 . Correlation of TOEFL scores to second 
year academic gradec for non-ESL students. 
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• CHAPTER V 

DISCUSSION AND IMPLICATIONS 

In Chapter I, I discussed the need for predictors of 
academic success for international students who come to the 
U.S. to study. I believe the results of this research show 
that students' performance in intensive English programs 
does have predictive validity—more so, perhaps, than do 
pre-test scores— but must be used cautiously and in 
combination with other factors. Although the students 
whose TOEFL scores gained them immediate access to academic 
study maintained higher grades during the first two years 
than did their counterparts who had taken ESL classes, that 
difference narrowed considerably from the first quarter to 
the second year. As we saw, this equalizing was not due to 
the ESL students' grades rising, but rather because those 
who began study without intensive English training started 
with strong grades and then those grades dropped. These 
and other factors will be discussed in this chapter. 

PREDICTIVE VALIDITY OF ESL GRADES 

As Table I on page 34 shows, there were several 
statistically significant correlations between ESL grades 
and academic grades. The problem I see with those 
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relationships, though, is that none of the correlations are 
particularly strong for the whole group and for all the 
components of ESL. I think there are several possible 
explanations for this phenomena. 

The Perceived Goals of ESL Instruction 

There are perhaps mixed teaching targets among ESL 
teachers and TAs in the PSU setting. For one thing, there 
is an attempt to help students achieve a TOEFL score that 
will admit them to academic study, and the correlations 
between TOEFL scores and ESL grades suggest that this 
target is at least partially met. Longitudinally, ESL 
students' average scores on both the Michigan and TOEFL do 
improve as they advance from one program level to the next^ 
as well. 

The second perceived goal of the ESL program is to 
prepare students culturally for an extended stay in the 
U.S. and for the academic environment here. Many of the 
texts and activities, especially in the lower levels are 
directed toward this objective. For example, Asian 
students, who are known for passivity in the classroom, are 
drilled on the necessity to become involved, not only in 
the classroom, but to take some responsibility for their 
own learning. Many activities such as group work in class 
and oral presentations backed by research and using 
audio/ visuals force them to adjust at least somewhat to 
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this norm. Male students from countries of the Middle 
East, on the other hand, are usually gregarious and do 
participate extensively in class. But it is not uncommon 
for some of them to think' (and act) as though they can 
change a grade by friendly but unrelenting pressure on an 
instructor. This can happen but is far less likely and 
acceptable in American culture than in some others. Much 
of the content of lower-level ESL classes is heavily 
oriented toward American cultural information — family life, 
leisure activities, male-female roles, the educational 
system, food, religions, holidays, etc. This cultural 
sensitizing may be one of several factors that helps the 
ESL students maintain their college grades over time, while 
students without it seem to have trouble doing so. 

A third objective, and one that seems it should be of 
high priority, is to help the ESL students become 
proficient not only in general English, but in the academic 
styles and registers of their reading assignments once they 
enter regular content classes. It is in this area where my 
research results imply a weakness I will discuss in the 
following section. 

Weaknesses in Predictive Value of ESL Grades 

Variation in ESL Component Correlations . If all the 
component CPAs had correlated to academic CPAs as well as 
did writing, the overall ESL grade correlations would have 
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been quite strong. The speaking/ listening segment 
correlations, although not as strong as those for writing, 
correlated more consistently with academic grades than did 
those for either reading or grammar. 

In the lower levels of writing, emphasis is placed on 
personal and experiential writing, but at upper levels, the 
students research, write, and revise much as they will in 
their content courses. Writing in the ESL program here is 
strongly process oriented. These factors may explain in 
part the strong relationship between ESL writing and 
academic GPAs. 

The speaking/ listening classes is where most of the 
culture learning takes place. Not only are many texts and 
classroom activities directed toward this goal 
(particularly in levels 1-3), but there are activities 
outside the classroom that provide cultural orientation. 
In the two upper levels of this component, a strong 
emphasis is also placed on note-taking skills and practice. 
Students may actually attend a college lecture class and 
take notes as well as have guest speakers in their 
classrooms. They learn how to outline and abbreviate and 
practice doing so while listening to a variety of language 
accents or dialects, tape recordings, and live voices. 
This preparation, which reinforces activities in the 
writing class by virtue of emphasizing organization and use 
of schemata to reduce uncertainty, may explain at least 



part of the consistent positive correlations between this 
component and college grades. 

It is difficult to understand the extreme variation in 
relationships between grammar and academic grades for 
students from the Middle East, with a negative -,548 

correlation, and that of Asian students, with a positive .504 

correlation. Perhaps grammar, thought to be the most 
subconscious part of language learning, is of little 
benefit when taught explicitly, except as it relates to the 
TOEFL. It might also be that learning versus teaching ^ 
styles play a major role: students whose cognitive style is 
inductive (creating rules and generalizations from specific 
examples) may not benefit much from a deductive (presenting 
grammar rules explicitly, then giving examples) teaching 
style. The reverse, of course, would also be true. And 
the two senior instructors in PSU's ESL program teach 
grammar in these opposite styles. Another possible answer 
may lie in the degree of contrast between the students 
native language (NL) and English, the target language (TL) . 
Based on research done by Oiler and Ziahosseiny (1970) , the 
more similar the TL is to the NL, the more difficult it may be 

to learn — there is not enough contrast. Since English 
grammar is far more sim'^'lar to Arabic grammar than it is to 
graitonars of Asian languages, the students from the Middle 
East may have much more difficulty with grammar learning 
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than do Asian students without regard for their academic 
skills and performance. 

The correlations between ESL reading and college 
grades were consistently lower than were those of any other 
components. Also, the majority of negative correlations 
among the subgroups appeared in this component. Although 
both women students and students who had previous English- 
speaking college experience showed strong, positive 
correlations here, most groups did not. Since reading is 
supremely important in most university classes, it seems 
logical to assume a strong relationship between grades in 
ESL reading classes and those in later content courses. 

One explanation may be that reasonably objective 
grading is difficult in reading classes. This does not 
seem likely, though, because most of the ESL teachers I 
know (including me) think that both writing and 
speaking/ listening are more difficult to grade objectively 
and consistently. (The distribution curve for ESL reading 
grades was similar to those of the other components as 
Appendix C shows) . Average reading grades were slightly 
lower than for other components, however. 

A more probable explanation lies in the nature of 
reading material selected for ESL students. Until a little 
more than two years ago, the ESL program at this university 
was under the auspices of the English Department, and most 
of the teachers currently in the program obtained their 
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M.A. degrees from that department • Because of these 
influences, the reading materials used by most teachers in 
the program lean heavily toward the literary rather than 
the scholastic. I believe literature has a valid place in 
learning a language; but the dramatic variations in style 
among literary works, the lack of academic-type registers, 
and the difference in content between fiction and poetry on 
the one hand and college textbooks on the other, perhaps 
contribute to schema and vocabulary weaknesses during the 
first several quarters of college as well as difficulty in 
reading academic style and registers. Reading materials 
other than literature are used — things such as newspaper 
and newsmagazine articles, articles about local and 
regional characteristics and history, various types of 
essays, and readings selected from ESL textbooks, but 
rarely are they academic both in style and content. 

Of 169 subjects in this study, only two were majoring 
in a literary field, while 92 were majoring in less-verbal 
fields— fields such as engineering and math. Additionally, 
most of those majoring in more-verbal areas were students 
in the School of Business. Only a few of these students 
will be exposed to more than one or two literature courses 
during their stay here, but all will be required to do 
substantial amounts of academic and technical reading. My 
conclusion, then, is that extensive exposure to college- 
type writing styles and registers could make the reading 
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component grades correlate better with those of later 
academic study. (Notice the difference between reading- 
second year academic GPA correlations for less-verbal 
majors- — negative -.045, and more-verbal majors — positive .437). 

This is an area where adjunct courses — ESL classes combined 
with entry-level academic classes — could benefit students 
at the intermediate and upper levels of the ESL program. 
Study methods that would enhance students' reading speed, 
comprehension, academic vocabulary, and understanding of 
the typical organization of entry-level textbooks could be 
included, orienting the classes toward English for Specific 
Purposes — a strong current trend in ESL worldwide. 

Overlap of ESL Subgroups , Scanning the Pearson 
correlations in Chapter IV could lead one to believe that 
ESL grades are excellent predictors of university success 
for certain groups of students — women, Asians, those who 
took twelve or more ESL classes, those who are in more- 
verbal majors, and students younger than 24 years of age. 
But a closer look shows the situation to be more complex. 

The tables in Appendix B show the composition of the 
subgroups. All but 3 of the 27 women students were Asian, 
nearly 2/3 of them took twelve or more ESL classes, and 57% 
were in more-verbal majors. Conversely, more than half the 
male students were from the Middle East, about 60% of them 
took fewer than twelve ESL classes, and 2/3 were in less- 
verbal majors. Because of these crossovers it is difficult 
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to determine which variable (s) might have had the strongest 
effects. If, for example , most of the female students were 
from South America, would they still show strong 
relationships between ESL and second year CPAs? It seems 
that without corroborating research that uses students of 
different nationalities, there is no way to say with 
reasonable assurance that ESL grades can be used in a 
general manner to predict academic success for students 
from certain cultures or genders more than for others* It 
is reasonable to say, though, that at Portland State 
University, the ESL grades of Asian female students who 
take twelve or more ESL classes and are majoring in a more*- 
verbal area have very strong predictive value. It also 
seems reasonable to conclude that the ESL grades of male 
students from countries of the Middle East who take between 
four and twelve ESL classes and major in less-verbal areas 
have no predictive value at all, at least at this 
university . 

Other Factors . VThile the composition of the subgroups 
precludes using their ESL-academic grade correlations with 
certainty as predictors of academic performance, another 
element adds to that uncertainty. The sample size within 
each subgroup was adequate, I think, to draw some 
conclusions from the correlations for the first academic 
quarter and, in most cases, the first academic year* The 
problem is that the strongest relationships found were with 



second year grades where the N ranged from a low of seven to 

a high of 27 with the majority in the teens • This 
situation explains why the levels of statistical 
significance for the strong ESL-second year correlations 
were not as great as those for some of the weaker ESL-first 
year correlations. 

The uniformity of mean ESL GPAs among subgroups also 
raises a question. All but five of eighteen were between 
2.49 and 2.62. I see two possibilities here: one is that 
my point assignment to P-NP grades (a little more than 1/4 
of the total classes) and my GPA computations that included 
Ds and Fs as well as the higher repeat grades had a 
leveling effect; another is that ESL grading, at least at 
this university may suffer from some sort of unconscious 
uniformity on the part of the ESL teachers (the variation 
in mean academic GPAs was broader, ranging from 2.53 to 
2.92). A look at the distribution graphs in Appendix C, 
however, seems to defy these explanations. 

Finally, the discovery that stu.:,:': ^.ts who had 
previously attended English-speaking colleges performed 
significantly poorer in ESL than did those without that 
experience makes little sense to me, because I expected 
that their previous exposure to formal English would help 
them do better. One explanation might be that because they 
had previously studied in English, they were upset over 
being required to take intensive English classes (perceived 
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by them as remedial) , and therefore did not do as well as 
the other subgroup* 

Mean Academic GPA Differences 

Three of the five student groups that showed the 
strongest ESL-academic grade relationships — female and 
Asian students and those who had attended two quarters or 
more of college prior to arriving at PSU — received college 
grades that were significantly higher than those of their 
subgroup counterparts; and students in more-verbal majors, 
who also had strong ESL-academic grade correlations, earned 
college grades that were higher than their counterparts in 
less-verbal majors, although the difference here was not 
statistically significant* I think these data point to a 
valid connection between strong ESL-academic grade 
correlations and superior college performance* At first 
glance it appears that comparisons between the students ' 
ESL-academic grade correlations and their mean academic 
GPAs is somehow inconsistent* The groups witV. lower ESL- 
academic grade correlations maintained mean academic grades 
that were very close to their mean ESL grades, indicating a 
strong rather than a weak correlation; but the subgroups with 

strong ESL-academic correlations had mean academic grades 
that were higher than their mean ESI. grades. For example, 

the group means for both female and Asian students jumped 
*31 or more from ESL to the first academic quarter. Yet 
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those for male and Middle-Eastern students remained quite 
uniform. The group means are shown in Table XXVII. 

TABLE XXVI 

ESL AND ACADEMIC SUBGROUP MEANS BY GENDER & NATIONALITY 



Subaroup 


ESL 


1st Otr 


1st Yr 


2nd Yr 


Female 


2.58 


2.89 


2.92 


2.90 


Male 


2.57 


2.63 


2.55 


2.61 


Asian 


2.52 


2 .86 


2.85 


2.81 


Mid-Eastern 


2.54 


2.62 


2.55 


2.58 



A look at the scattergraias for males and females on 
pages 37 and 38, however, shows the reasons for this 
phenomenon. As a whole, the males tended to do better in 
ESL than in academic courses, but there were a scattered 
few who had very high ESL grades with average or worse 
college grades and others with rather low ESL grades who 
did quite well in content studies. The female students' 
grades on the other hand show a more typical positive 
correlational sweep from the lower left corner to the upper 
right corner of the graph. 

COMPARING ESL AND NON-ESL STUDENTS 

Although non-ESL students' average grades are still 
slightly higher at the end of the second year than are 
those of ESL students, the gap has narrowed substantially. 
And if we compare the average non-ESL second year grades to 
those of the ESL students who scored 500 or more on the 
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TOEFL, there is essentially no* difference at all — 2.82 
(SD=.612) and 2.76 (SD=.439) , respectively. This pattern, 
much the same as that within the ESL group between students 
who tooK,.^*^er than twelve and those who took twelve or 
more ESL classes, may imply some relationship between 
intensive English study and the long term academic success 
of students. It would be interesting to look at mean GPAs 
for the main groups at the end of the third and even the 
fourth year. How would they compare at those times? 

The findings here were not what I expected. I assumed 
that ESL students college grades would start lower and 
climb as they became more English-proficient. Grades of 
non-ESL students, on the other hand, I expected to start 
higher and stay there. The patterns I found raise a 
question of cultural and academic adjustment, including 
study and note-taking skills; and those are perhaps the 
areas in which an ESL program is best able to assist its 
students . 

TOEFL SCORES AS PREDICTOR 

I performed Pearson Correlation Coefficients between 
TOEFL scores and GPAs, and although I did not predict 
results for those tests, the findings did not surprise me. 
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TQEFL-ESL Grades 

The research I reviewed that had investigated this 
relationship indicated moderate to strong and statistically 
significant correlations between these numbers • Because 
one of the goals of the ESL program at Portland State is to 
assist students in obtaining a TOEFL score high enough to 
gain them admission, I expected at least a moderate 
relationship between TOEFL scores and ESL grades, and I 
believe the results show that. The Test of Written English 
(TWE, a writing test created for use with the TOEFL) is 
usually not given to students entering this university, and 
therefore, the correlation between ESL writing grades and 
TOEFL scores is rather weak, though statistically 
significant. Grammar proficiency figures heavily in the 
TOEFL, as do listening skills; and the correlation with 
grammar was the strongest of the four relationships, while 
speaking/ listening was only slightly less so. Although the 
TOEFL does not test speaking production, it does test 
listening comprehension, and that element is a big part of 
the speaking/ listening classes. It appears that this goal 
of the ESL program is being met, at least to some extent. 

TOEFL-Academic Grades 

Because most of the studies I re'^'^iewed that looked at 
TOEFL score-college GPA relationships found mostly small to 
moderate positive correlations, a few of which were 




statistically significant, I expected similar results. 
None of the other researchers, however, separated ESL from 
non-ESL students to see if there were differences between 
correlations for those groups. The two extremely small 
negative and one extremely small positive correlation for 
the non-ESL students essentially shows no relationship 
whatsoever; yet these tests are required by most American 
universities to determine whether an international student 
whose first language is not English must enter the 
intensive English program or is permitted to begin academic 
study immediately. In at least some cases this is so even 
if that student comes from a country where English is an 
official language ( e.g., India, Nigeria, Singapore, 
Indonesia) and the student has used English from childhood. 

In contrast to the TOEFL score-academic grade 
correlations of non-ESL students, those for the ESL 
students were all positive (although weak) and one — that 
for the first year academic GPA — was statistically 
significant. It is not possible to draw any solid 
conclusions from this difference, but itf may again suggest 
some connection between the type of preparation received in 
the ESL program and academic performance — the intensive 
English program goals of h^ xng students improve TOEFL 
scores, academic performance, and to adjust culturally. 

The f-tests performed on the mean academic grades of 
the TOEFL score subgroups seems to contradict the results 
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of the TOEFL score-academic GPA correlations for ESL 
students: while the correlations were very low and not 
statistically significant, the results showed both large 
and, in two cases out of three, significant differences in 
academic grades between those students who received a score 
of less than 500 and those who scored 500 or uiore on the 
TOEFL. Since no differences existed between the TOEFL 
subgroups in the non-ESL groups (divided at a score of 
550) , the results suggest the possibility that a score of 
around 500 on the test is a breakpoint below which students 
generally do not do well academically, but above which 
(regardless of how far above) they perform better. 

Another possibility is that ESL grades and TOEFL 
scores combined have more predictive value than either does 
by itself: the ESL grades of students who scored 500 or 
better on the TOEFL were significantly higher than those of 
students who scored below 500. 

SUMMARY AND SUGGESTIONS FOR FURTHER RESEARCH 

I believe this research has investigated in greater 
depth and breadth the relationship between ESL and academic 
performance than have most others I reviewed, and because 
of that has suggested some helpful implications for both 
intensive English programs and university admissions 
offices. Despite this, there are several problems I see 
that should be addressed in future studies: a) ESL grades 
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need to be compared to grades at or near the end of college 
study — perhaps at year three or four years or upon 
graduation (fewer than a dozen of my subjects had 
graduated, and the total time in academic study for them 
ranged between 5-7 years) in order to better evaluate the 
long-term relationship between ESL and academic CPAs; b) 
comparisons of non-completion rates should be made between 
ESL and non-ESL students; c) sample or population sizes 
should be larger and more consistent over time (i.e. from 
ESL classes through several years of academic study) ; 
d) comparison between ESL and non-ESL students need to be 
made over a longer time period; e) subgroups with more 
internal variation should be used to better predict which 
variables truly affect the predictive value of ESL grades; 
and f) how learning styles and attitudes toward intensive 
English study affect the ESL-academic performance 
correlation. 

Relating to the last point, it is quite clear that 
Asian students, for example, have learning styles different 
from those of Middle-Eastern or South American students. 
Attitudes are different as well: in my experience, Middle- 
Eastern students generally protest the most when required 
to take intensive English classes and complain of little 
value in them, while Japanese students seem eager to learn 
English in any way possible. But are these factors related 
to nationality and culture? Or are they more heavily 
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related to the perceived value of ESL classes for major 
fields of study? The majority of Japanese students at PSU 
major in more-verbal fields while all but one of the 
Middles-Eastern students in this study majored in less- 
verbal fields. 

It is likely that different intensive English programs 
vary in their focus, approach, content, and methods • If 
that is so, a large project across several universities 
would be desirable to produce information that could be 
used to make broader generalizations. Such a study would 
also solve some of the problems listed in the two preceding 
paragraphs . 

It is apparent that TOEFL scores are not good 
predictors of student academic ability or success, and even 
the Educational Testing Service (ETS) , its creator and 
administrator, clearly states that. Also, it is a tortuous 
ordeal for most students who go through it — in many cases, 
for example, they are not allowed to use a toilet during 
the several hours of testing. And if they arrive in the 
U.S. shortly before they take the test, they are likely to 
be suffering from cultural disorientation. Finally, it 
gives no information on the cultural preparedness of the 
students who take it, and perhaps that element is as 
critical to their educational success in this country as is 
basic English proficiency. It may, however, have some 
predictive value when used in conjunction with ESL grades. 
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Looking at the results of this research as it applies 
specifically to this university and its ESL program, it 
seems that some guarded conclusions can be drawn. The 
first is that there are variables that influence the 
relationship of ESL and academic performance as well as 
academic performance itself. Although it is not clear from 
this study which of them has or have the most influence, it 
is probable that the number of ESL classes taken, gender, 
and nationality are the most important, since subgroups 
within those categories showed the greatest differences of 
all the variable groups in their ESL-academic grade 
correlations; also two of them, gender and nationality, 
showed the largest subgroup differences among the variables 
in general academic performance. 

The second is that some combination of cultural 
orientation, study skill training relevant to U.S. 
university study, and English language proficiency is the 
best preparation for successful study here. If one looks 
at the difference in GPA patterns, for example, between the 
students with the most time spent in the ESL program versus 
those who have spent little or none, it seems that the 
program does in some way help students academically. 
Although most of the non-ESL student declines in mean GPA 
from the first academic quarter to the second academic year 
did not show acceptable levels of statistical significance, 
I believe this pattern has some meaning and value. More 
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research similar to this is needed to corroborate the 
results found here* 

A final conclusion is that the reading component of 
the ESL program does not seem to be preparing students for 
academic success. It is odd that English reading ability, 
so crucial in university study, would show such small and 
irregular correlations with college grades, while 
grammatical proficiency — something that seems of much less 
importance, particularly in the sciences — correlated better 
and more consistently with academic grades for most of the 
variable subgroups. 
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APPENDIX A 
MAIN GROUP COMPOSITION 
COMPOSITION OF MORE-VERBAL AND LESS-VERBAL MAJOR AREAS 



# # 





Major 




ESL Ss 


Non-ESL Ss 


M 


Accounting (w/more-verbal 


minor) * 


1 


A 

4 


0 


Arts & Letters 




0 


1 


R 


Business Administration 




14 


rt 
9 


E 


Business Info Systems 




1 


A 

4 




Economics 




7 


7 


V 


Finance Law 




2 


G 


E 


General Studies 




4 


1 


R 


International Studies 




1 


3 


B 


Marketing 




1 


4 


A 


Political Science 




0 


1 


L 


Psychology 




2 


z 




Sociology 




1 


0 




Theater 




1 


0 


L 


Accounting ( w/less-verbal 


minor) * 


3 


4 


E 


Pre-Architecture 




0 


1 


S 


Art 




2 


4 


S 


Biology 




2 


2 




Civil Engineering 




2 


4 


V 


Computer Engineering 




2 


4 


E 


Computer Science 




8 


10 


R 


Electrical Engineering 




8 


13 


B 


Math 




3 


1 


A 


Music 




1 


2 


L 


Mechanical Engineering 




4 


3 




Pre-Medicine 




1 


0 




Pre-Pharmacy 




1 


0 




Physical Education 




1 


2 




Science ( general ) 




4 


0 



*The first two years of accounting is heavily numbers 
oriented and would seem to argue for placing it in the 
less-verbal group. But upper level theory and 
auditing classes emphasize more decision-making in the 
real world of the organization, regulations, 
intra-company communication, and information systems. 
Therefore, I opted to divide accounting majors based 
upon their minor fields of study. 
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COMPOSITION BY GENDER 



/ 

# ESL SS # Non-ESL Ss 



Male 49 60 

Female 28 32 



COMPOSITION BY AGE 



# ESL Ss # Non-ESL Ss 







ij6ss tnan ^4 yeajrs 


O Q 

->o 










o ^ <^ n ^* 
























ci L> X\ji icij. X jr 




# Non- 


-ESL Ss 


A 




Hong Kong 


1 




5 


S 




Indonesia 


5 




19 


I 




Japan 


20 




5 


A 




Korea 


5 




1 


N 




Macao 


0 




1 






Malaysia 


1 




8 






Ppl's Repub. China 


9 




5 






Singapore 


0 




4 






Taiwan 


3 




4 






Thailand 


0 




1 


M 


E 


Iran 


3 




2 


I 


A 


Israel 


0 




2 


D 


S 


Jordan 


9 




0 


D 


T 


Kuwait 


0 




2 


L 


E 


Lebanon 


3 




2 


E 


R 


Oman 


2 




0 




N 


Pakistan 


1 




3 






Saudi Arabia 


2 




0 






Syria 


4 




2 






Yemen 


3 




4 
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COMPOSITION BY NATIONALITY 
(continued) 



0 


Belgium 


0 


1 


rn 
1 






2 


H 


Ghana 


0 


1 


E 


Greece 


5 


2 


R 


Grenada 


0 


1 




Iceland 


0 


2 




Italy 


0 


1 




Kenya 


0 


2 




Nigeria 


0 


1 




Norway 


0 


6 




Senegal 


1 


0 




Sweden ' 


0 


2 




Yugoslavia 


0 


1 



It would require an extremely large sample in order to 
determine the influence, if any, of specific 
nationality. Since the primary concern here is the 
ESL student, and since all but six of those students 
in this study were either from Asia or the Middle 
East, this division seemed natural. While there 
substantial cultural and language differences among 
the nationalities within the two larger groups, the 
students within each share more cultural and learning 
style similarities than they do with those in the 
other group. 



COMPOSITION BY PRIOR EDUCATION LEVEL 

Level # ESL Ss # Non-ESL Ss 

HS up to one quarter college 43 29 

Two quarters or more 34 63 



COMPOSITION BY PREVIOUS ENGLISH-SPEAKING 
COLLEGE EXPERIENCE 

# ESL Ss # Non-ESL Ss 



Yes 
No 



This experience was predominantly at American 
junior colleges and universities, but about 10% 
of the subjects under "yes" had attended colleges 



23 
54 



32 
60 
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in Canada, Australia, Great Britain, or other 
English-speaking countries. 



COMPOSITION BY TOEFL SCORES 



# ESL Ss # Non-ESL Ss 



Less than 500 28 

500 and up 4 3 

Less than 551 35 

551 and up 48 



COMPOSITION BY DATE OF PSU ENTRY 

# ESL Ss # Non-ESL Ss 

Entered prior to Fall, 1988 34 19 

Entered Fall, 88 or later 43 73 
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APPENDIX B 

BREAKDOWN BY SUBGROUP 

BREAKDOWN BY NUMBER OF ESL CLASSES TAKEN 

4-11 Classes 12 and up 

39 38 

The fewest nuxober of ESL classes taken was 4; the 
most, 33. These include classes at other colleges 
in the U.S., Canada, Australia, and Great 
Britain — 66 classes, or 7% of the total of 994. 

BREAKDOWN BY MAJOR, ESL 



Subgroup More-verbal Less-verbal 



Male ■ 


19 


30 


Female 


16 


12 


Asian 


24 


20 


Mid-Eastern 


10 


17 


< 24 years old 


24 


14 


24 and older 


11 


28 


< 12 ESL classes 


18 


20 


12 and more 


17 


22 


Prev Amer College 


10 


13 


None 


25 


29 


BREAKDOWN BY GENDER, 


ESL 


Subaroup 


Male 


Female 


Asian 


20 


24 


Mid-Eastern 


24 


3 


< 24 years old 


27 


11 


24 and older 


22 


17 


< 12 ESL classes 


28 


10 


12 and more 


21 


18 


Prev Amer college 


16 


7 


None 


33 


21 
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Mid-Eastern 



< 24 years old 23 
24 and older 21 






13 
14 


< 12 ESL classes 19 
12 and more 25 






13 
14 


Prev Amer college 12 

Mono 32 






10 

17 


BREAKDOWN 


BY AGE, 


ESL 




Subaroup < 24 






24+ 


< 12 ESL classes 19 
1 9 anri Tnorp 19 






19 
20 


Prev Amer college 10 
None 28 






13 
26 


BREAKDOWN BY 


# ESL 


CLASSES 




Subaroup < 12 






12+ 


Prev Amer college 14 
None 24 






9 
30 


BREAKDOWN BY 


MAJOR, 


NON-ESL 




Subaroup More 


-verbal 




Less-verbal 



Male 20 

Female 23 ^ 

Asian • 27 26 

Mid-Eastern 1 



BREAKDOWN 


BY GENDER, NON-ESL 




SubarouD 


Male 


^-emale 


Asian 


29 


24 


Mid-Eastern 


15 


1 



/ 
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APPENDIX C 



GPA AND TOEFL SCORE DISTRIBUTIONS 
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Overall ESL GPA distribution. 
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ESL grammar GPA distribution. 
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ESL reading GPA distribution. 
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ESL writina GPA distribution. 
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ESL speaking/listening GPA distribution. 
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ESL student 1st quarter academic GPA distribution. 
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Non-ESL student 1st quarter academic GPA distribution. 
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ESL student 1st year academic GPA distribution. 
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Non-ESL student 1st year academic GPA distribution. 
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ESL student 2nd year academic GPA distribution. 
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Non-ESL student 2nd year academic GPA distribution. 
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ESL student TOEFL score distribution. 
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